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PREFACE 

There iiiay not bo an obvious or direct relationship between economic 
developmaat and follaw--up of vocatioaal graduates; but to the extent that 
vocatioaal training produces skilled manpower, follow=up data will measure 
the success or failure of such an endeavor* Follow-^up data^ thcsreforei are 
essential to plan and evaluate the developmeiLt of human resources which are 
essential for industrial and eccnQmic development* 

In addition to their usage as an evaluative measure of vocational 
trainings* suecassj, fDllow-up data provide an essential dimension to the 
information systems for human resources pj.anning* The concepts of manpower 
supply and demand are highly related to placement on jobs. Success or failure 
of program participants can best be verified by the kind of jobs on whJ.ch they 
are placed. Verifying the placement is an important function of follow--up. 
Plaraaing and implementation of vocational education^ an^ for that matter any 
manpower development program j will be incomplete without appropriate follow-up 
data* 

In spite of the research efforts of over a decade and hundreds of studies ^ 
we still have not developed adequate measures which would be acceptable to most 
administrators of vocational education or manpower programs* On the following 
pages an effort has been made to recap these research efforts with the hope that 
it will show the need for development in critical areas of follow-up and 
evaluation* 

Krishan K* Paul 
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INtROUUCTION 

Billions of dollars ar® spent every year in the United States to bridge 
the gap between jobs and people by training the youths and adults in occupa^ 
tions needed by an axpanding economy and increasingly complax technology- A 
numbar of federal^ state, and local goverrmient agencies from the public sectorj 
labor unions J privata schools, and individual employers from the private sec- 
tor are all involvad in this monumental task of human resource developmant 
which is crucial to economic growth and technoJlogical progress* 

Although most of the formal training Is provided through a large number oJ 
vocational education programs administered by public and private schools and a 
host. of federal agencies including military and the manpower programs , individual 
employers and labor unions contribute significantly to the training effort. As a 
total national effort the formal training programs represent a stag^^ering invest-- 
ment in human capital, although it may still be far short of actual needs. The 
dollar amount spent on training surpasses the annual defense budget, and it is per- 
haps the largest undertaking In the country in terms of employment and jobs* And 
yet^ the success (or failure) of vocational education programs is measured only 
partially and often Intuitively rather than analytically using economic and statlS'- 
tical analysis techniques* 

To complicate an already complex situation the U, S. has not yet adopted a 
well enuciated manpower policy or a coherent human resourca development plan which 
would set up goals and objectives for the nation to achieve in the near as well 
as the distant future. Human resources development efforts of the United States 
are like a modern ship which is fitted wit-h the very latest technically sophisticated 
devicesj but which has not been provided with either destination or navigational 
charts, 
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Let us consider vocational education, for eKampla^ which offers thousands 
o£ training courses with student enrollment in the millions* The passage of the 
Vocational Education Ant of 1963 mandated the states to submit annual and long- 
range plaas to the federal govermnent. However, no direction or target was given 
to the states as a framework in which to fit their Individual local plans. There 
was no provision for the federal government to formulate a national policy or a 
plan* In the absence of any overall direction^ state plans are heterogenous in 
objectives though fairly uniform in technical format* The consolidation of such 
state plans does not suffice as a substitute for a national plan for vocational 
education* 

A similar situation also exists for other human resource development programs 
supported and sponsored by the federal government* In the absence of a well 
articulated and cohesive manpower policy , state and local plans for manpower 
development are reduced to a patchwork effort rather than a well-jointed and 
well coordinated endeavor aimed at meeting national manpower needs including those 
of industry and business. 

Absence of national manpower policy also results in duplication of efforts 
by different federal and state agencies* Many a timej training programs initiafedp 
sponsored, and supported by the U» S. Department of Labor are not coordinated with 
those sponsored and supported by the U, S* Department of Health j Education, and 
Welfare. Absence of clear guidelines encourages f ragraentation of efforts at the 
local level also* 

This paper focusua on the isBUO^ and Lr^nda in evaluation of vocational 
education programs and their implications for human resource development* Some 
of the trends, and most of the research effort, is, however , as appropriate to 
manpower programs as vocational education because the overall purpose of both is 
development of human resources* Purpose of Vocational Education Act of 1963 is 



\ 

stateid as the education which is renlistic in the lighc of actual nr I 

anticipated opportunities for gainCul €i:nployment . " Tliia statcnient of pur^ 
pose is general enough to fit any iiianpower development program whathui: it 
be providad through a vocational scbocd or an ernployer providing on=the--job 
training to youths and adults. 



-4- 



REVIEW OF CURRENT TRENDS 

The passage of. the Vocational Education Act of 1963 which mandated 

the states to prepare statewide vocational aducation plans started a flurry 

of activity related to the planning proctass. Under the impetus of federal 

funding old procesaes were modified and new planning processes were developed 

to help local and state administrators of vocational education* Howevers 

thets has been no coordination among the states to seek a unity of purpose or 

approach* Consequently^ there is no uniformity or standardiEaLion in the 

planning process andj therefore^ state plans* There are dozens of studies on 

the development of planning systems * pilot testing of planning systems, and 

installation of planning systems* But, studies on the workings of planning 

system s are conspicuous hy their absence. There is a serious shortage of in^ 

formation on how planning, is actually working. Lawrence and Dane (197A) , 

while commenting on the Program Planning and Budgeting System (PPBS) , deplore 

the scarcity o£ evaluative data as the following: 

There is also a shortage of Information on the success 
or failure of planning, though there is now sufficient 
information available to Indicate that PPBS may not be 
fulfilling its early promise and that other planning 
systems are aurvlvliig aground on a rock called "lack 
o£ data*" 

There is an urgent need to evaluate existing vocational educational plans 
and their outcomes before embarking on additional planning systems or efforts, 
A set of wall tested and valid measures also need t j be developed in order to 
evaluate vocational education plans and their outcomes* 

Literature is replete with studies which tend to evaluate vocational education 
programs* Most of these studies are descriptive though some have used experimental 
design quite effectively. All evaluative studies, however^ are conducted to 
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answer the following quest iona which are oT cunHidurable interest to planar 
and program adraiiiistratous , 

1, What happens to the youths and adults who after completion of their 
training try to find work rather than continue schooling? 

2, Are there significant differences between the Job--related experiencas 
of persons who cQinplete vocational education programs and those who 
do not? 

3* Do the vocational education programs justify their cost? 

Studies varying in design and scope have tried to find answers to one or 
more of the above questions. Many of these studies have also tried to develop 
and pilot-test methodologies to compile a data base by surveying former students 
of vocational education programs. These evaluative af forts are generally termed 
as follow-up studies. 

It is hard to classify evaluative and follow--up studies on the basis of 
either design or scope. The following classif ieation is for convenience only 
and does not reflect any distinct design or scope features. Many of the studies 
could very well be classified under more than one heading. There is, therefore, 
no rigidity to this system and it should be considered flexible as far as the 
scope and design of studies are concerned. 

Following are the four groups in which follow-^up studies have been divided 
for review in this paper, 

1, Administrative reports 

2, Comparative studies 

3, Cost-benefit analysis studies 

4* A fourth group of studies relates to the development of technology, 
instrumentation, data syatams, niathodology, and guides and luanuals. 
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It is neither the intent nor the scope oE this paper to review all 
follow'-up studies conducted In the United States to evaluatf^ vocational 
education programs* Only a few of the representative studies and their 
results are discussed on the following pages to illustrata the emerging 
trends in vocational education program evaluation. 

Admialstratlve Reports 

A survey of literature reveals a large number of studies which though 
different in scope, appiroachs and methodology, can best be described as 
administrative reports. The result or outcome of these studies is required 
for administrative reports from local to state and federal administrators* 
These reports may be based on nationwide or statewide surveys of former 
vocational education students or they may be based on a verbal inquiry by 
an instructor of a vocational program* The information compiled and trans-- 
^ mltted in these reports generally is of the following pattern: 

1. Job placement: whether (the former vocational trainee was) placed 
on a training related^ unrelated (to training) job, or if (he was) 
still unemployed, 

2. Wages: monthly* weekly, or hourly wages earned by those (who were) 
employed , 

3. Continuing Educationi whether continuing to attend school for more 
education or training, 

4. Evaluations how the program and educational services pravided were 
rated (by the former trainee). 

5. Counseling Services* whether coun ling and job placement services 
were provided while in schools 

6. Demographics^ age, sex, location, etc. 

ERIC 1 0 



It should be pointed out here that these points are il].ustrative only 
and do not represent the full spectrum of data classification used in these 
studies, Howevarj all studies in this grouping play a very useful role in 
vocational education program evaluation and planning by providing a data base 
for decision making at various levels of program udministracion. They are 
also Important as a cotnmunicatior link between the locals state^ and federal 
admiaistrations also» 

Eningar (1968) conducted one of the most comprehensive follow-^up studies 
with a sample of 5,327 former students of vocational programs drawn from one 
hundred randomly selected schools. The study was designed to evaluate voca-= 
tional programs by providing the information on 1) time required to get a full- 
time jobs 2)relatedness of job to training, 3) earnings ^ 4) job satisfaction, 
and 5) itiobilit>* Data on job stability and employer satisfaction were also 
compiled. To provide a longitudinal dimension to the study, Eninger surveyed 
the classes of 1943 s 1958, and 1962. Some of the other variables used In this 
study to compare graduates' post^school performance were the amount of school^ 
Ing after termination of vocational training, types of leisure actlvitiess 
organisational affiliations, and attitude towards Tiier schools and vocational 
programs* 

Some of the significant findings of this study were the following: 

1. A majority of the trade and industry (T&I) program graduates went 
directly to work after completion, though the jobs found by more 
than a third werB not relatad to their triiining. 

2. Starting wages depended on local labor markats, but the graduates 
with vocational training gained faster raises in wages than graduates 
from academic programs, 
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3, Graduates placed on trai^ning related jobs reported higher job 
satisfaction and job security than those placed On jobs unte- 
la ted to their training. 

4, About 87 percent of the graduates had not moved out of the coni'-^ 
munity in which they went to school* 

Another cpmprehenaive survey of vocational education graduates was 
conducted by the U, S* Office of Education in 1966 with 606s872 vocational 
graduates as subjacts. It was reported that 80 percent of all graduates 
available for placement found jobs for which they were trained, or jobs 
highly related to their training. Only four percent of the graduates were 
unemployed* The report also listed the occupations entered most frequently 
by the graduates. 

Paul and others (1972) in a statewide fQllow^up survey in Kentucky 
studied ten thousand former students of vocational education^ the class 
of 1971 # A mail questionnaire was used for this survey with telephone 
and personal interviews to verify the responses and to offset or eliminate 
a possible bias ^iue to non-^response* Some of the important findings from 
this statewide survey were as follows: 

1, Of the 68 percent of former students available for placeraent, 
only 41 percent found jobs related to their training , and as 
many as fifteen percent were still unemployed at the time of 
the survey, 

2* Of the 32 percent not available for employmfauts 65 percent 
continued their schooling after the completion of their 
vocational trainings 

3» A list of jobs on which the former students warn fraquently placed 
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was compiled. Tiw most frequently reported jobs were "secretary" 
and "nurse aide*" 

4* A great majority of those working on training=^related jobs reported 
a higher degree of job satisfaction than those placed on unrelated 
K.^ jobs. 

The New Mexico State Department of Education < (1968) studied the experiences 
of graduates from four area vocational schools. Among the findings , significant 
ones are the following i 

1# Of the 31 percent of graduates who were gainfully employed , 82 

percent were working on training^related Jobs. 
2* The average graduate had been working on the job only a year 

or leas; htoce no readings were available on advancements in salary 
levels . 

3. Over 72 percent of those employed found jobs within or near their 
home cotmunitiess 

Another statewide study conducted by Green (1971) surveyed the parents 
of vocational students to determine their attitudes toward the vocational 
and technical programs in Nebraska. The parents indicated that public schools 
should place greater emphasis on meeting student needs whether they be prepar- 
ing for college or going to work, A majority of the parents felt that their 
ehildren were capable of making occupational plans and had the ability to 
succeed in their chosen fields , 

Bates (1968) studied migration patterns of aseociate degree graduates 
from Institutions in Oklahoma. He found significant differences among those 
who migrated out of Oklahoma versus those who found jobs within the state. 
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Those graduates who movad out of Oklahoma earned better salaries and wages 
than those who found jobs within the state. He also found that reasons to 
mova out of the state were more economic than social. As a footnote to his 
studyp Bates found that out'-of-state recruiters spent more effort and of- 
fered an average of 13 percent better salaries to associate-degree graduates 
la Oklahoma than the local employers* 

Taves and Collar (1964) studies reasons for out-migration of high school 
graduates in Minnesota rural coimQunlties* They surveyed a total of 739 grad- 
uates from rural schools. Some of their findings are the following i 

1, Higher the career aspirations of the graduataj stronger was the will 
to move* 

2, There was also a positive cor elation between the will to move and 
father's occupation, 

3, Generally^ older graduates tended to move more often than the younger 
ones . 

4, Graduates from areas with higher agricultural Income moved more often 
than those from lower agricultural Income, 

Kaufman and Lewis C1968) evaluated vocational education programs and cur- 
ricula in three cities In Pennsylvania in order to recommend improvements. They 
found that most students entered the world of work without specialized job- 
related training; an imbalance existed between the vocational program enrollments 
and the labor market composition; less than half of the male graduates obtained 
jobs that were directly related Lo thGlr training; and most of the graduates did 
not receive any assistance from the school counselors* 

Seamans and others (1972) evaluated the auto mechanics and automotive tech= 
nology programs to determine the need for improvement in curricula. They found 
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that the graduates felt the need for more extensive training in the 
apealalty^area and s better cornmunication between industry and automotive 
training p,rograms. They also expressed a need for licensing the training 
pfograms In order to regulate the supply of trained auto mechanics. They 
considered the wage .*:ate for auto mechanic program graduates lower than 
other program graduates. 

Vocational agriculture programs in Connecticut were studied by Quesada 
and Seaver (1972) , They found that graduates employed on non^farm jobs 
earned higher Income than those working on the farms and that many graduates 
felt that Future Farmers of America (FFA) had become impersonal and had Ig-- 
nored new fields related to agriculture. 

Fentress (1965) studied 320 former home economics students in Ohio. She 
found that two^thlrds of the home economics graduates were employed outside 
their homes but only about 25 percent in jobs related to homn economics. Similar 
studies have also been conducted surveying health occupations, office occupatlonaj 
distributive educations technical education, and trade and Industry vocational 
education programs* 

Another group of studies deal with special training programs such as 
!©TA, corrections, TAT (training and technology) etc* Noteworthy among these 
are Worth and others (1973), London (1967), U* S, Manpower Administration (1968), 
Dickover and others (1971), and Spencer and Berecochea (1971)* All these avalua-- 
tive studies are based on a follow-up of graduates and former trainees of their 
respective program areas. 
SumT ary 

Most of the research studies classified as Administrative Reports are demon'- 
stratlve efforts to assess the ratio of vocational trainees placed on jobs to 



those who continue their education^ or otherwise drop out of the labor 
market* These studies provide a valuable tool for the local and state 
administrators to assess their own programs as compared with those in 
other areas and states. They also provide the basic data to fulfill 
federal reporting requirements. The accumulation of these data at the 
etate and federal level establishes trends against which periodic perform-- 
ance of different states can be evaluated. However j to the extent that 
these studies remain individual efforts rather than a standardized nation^ 
wide effort, caution will need to be exercised in the use of these data 
for interstate comparisons* Performance of vocational training programs 
relevant to labor market participations of trainees within a state is ns^ 
sessed using these follow up data from Administrative Reports, 
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Comparative Studies 



There is another large group of studies which tend to evaluate vocational 
programs by comparing them with other vocational or n a-vocational programs. 
For eKample^ Eninger (1968) compared trade and industry program graduates with 
academic graduates and found that there was no significant difference between 
the starting wages earned by vocational or non^vocational graduates on their 
first full-tdjue Jobs. However^ vocational education graduates earned larger 
and fast l increments In their salaries and positions than the academic gra^ 
duates. 

Eawrldge and others (1970) tried to compare vocational programs with aca- 
demic programs for their ability to increase job=placement rate* The results 
were Inconclusive because data available from vocational and academic programs 
Were found to be non^comparable on significant variabiles* 

Paul (1970) compared private vocational school graduates with public school 
vocational graduates In Oklahoma* He found that private school graduates found 
Jobs related t© their training more often than the graduates from public schools. 
Also, the private school graduates earned, on an average , 31 percent higher in=- 
come on their first full-time job than the graduaues from public schools* On the 
other hand, about 12 percent of the private-^school graduates rated their training 
as "low" compared with only 5*5 percent by public school graduates* 

Haines (1965) compared weekly earnings of men and women graduates, of co= 
operative programs in offices, distributives, and trade and industry education 
progrMis* Some of his findlugs are listed belowi 

1* Trade and industry graduates earned higher incomes compared 
with office education graduates. 

1? 
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2m Jtole graduatas aarnad highar incomes compared with female 

graduates of all programs* 
3. Earnings of distributive education graduataj wera found lower 

than the gradaate of both the office » end trade and industry 

education. 

Kaufinan and Lawis (1968) in their survey of vocational grades in 
Pennsylvania found that no significant diffaranca existed in ratings earned 
(from thair raapactiva suparvisora) by the vocational graduates and non^ 
vocational academic graduates ralativa to their work performance. However ^ 
the gradu^.£es of vocatignal programs beliaved themselves to be better prepared 
for their jobs. A mjority of both male and female graduates reported that 
they were "less than completely satisfied with their pay and oppgrtunitles 
for promotion I in their first jobs. 

tony administrative reports and cost-^benef It studies could also be termed 
as comparative studies if data on more than one program were analyzed to draw 
CQmparisons, As suchp most of the stata raports and similar studies could 
potentially be used to compare the outcomes of one program with another. For 
example^ Paul (1972) compared the graduates and dropouts from vocational pro^ 
grams in Kentucky, Some of his significant findings are listed below: 

1* A larger percentage of droupouts was working full time than graduates. 

2. There was no significant difference in the wages earned on first jobs, 

3. More graduates were working on training related jobs than dropouts* 

4. Mora graduates were satisfied with their jobs than dropouts. 

5. Dropouts were more mobile than graduates. 

6. Droupouts v/ere characterized by being disadvanCages, from rural areas, 
and of male sex. 

18 
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The study also showed that dropout rate was lower among the handicapped 
than among the total student population. 

Data banks developed in California, ColoradOs Minnesota, Missouri^ 
Oklahomaj and Pennsylvania provide a great variety of deSGriptive informa^ 
tion which has been used to make comparisons between vocatiomrl programs and 
no a- vocational academic education* Comparisons have also been made between 
male and female graduates of vocational programs to determine the impact and 
efficieacy of different vocational programs* 

Although comparative studies lack the rigor of eKperimental research 
design, they provide an indication of differential impact of vocational education 
programs on different student populations. Differencea in cultural backgrounds 
and scholastic achievements of trainees eometitnes make meaningful comparisons 
difficult but the process has proved useful in establishing trends to Indicate 
Improvements in some program areas. These coraparative trends could be used 
to generate a limited amount of competition among program administrators in 
order to foster improvements and better efficiency. 



/ 

Goet-Benaflt Analysis Studies 

While there are hundreds of comparative studieSj projects, and admini=- 
stratlve reports evaluating vocational education^ very few have tried to 
analyze costs and economic benefits of vocational and manpower programs, 
Stromsdorfer (1972) siinimariged the problems and some of the reasons why 
studies in economic analysis were so few in number* Some of his findings 
are listed belowi 

1. Cost-benefit analysis should measure the increase in welfare 
or utility due to an educational progr^* No direct measures 
of utility are possible* Indirect measures s such as income, 
are aubstantially less than perfect* 
2* Adequate maasuras have not yet been developed to assess con= 

sumption benefits of vocational training. 
3# Similarly p non=market production and consumption are hard to measure. 
4. It is very difficult to sort out the net effect of any given educa- 
tional investment since all the eKperiences are aummulative. For 
instance^ It is almost Ijapossible to separate the benefits from in-- 
school vocational education and on^the--job training, because in most 
cases the latter may not be possible without the former. 
5* Area of social costs and social benefits is another one where very 

little work has been done to measure the economic variables and their 
effect, 

6* Economic acts, and their ef facts, of third parties external to the 
vocational education cannot be measured. 

kO 
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The problems of measurement make economic analysis of vocational 
education extrenely hazardous* During the last decade or so a few bqq- 
nomlsts have attempted to find some of the answers to the problems stated 
by Stromsdorf er* Hu and others (1968) conducted a before--and=af ter study 
to compare the cost and benefits of vocational and general curricula grad-- 
uatest Average monthly earnings of graduates one and six years after grad-- 
uation were compared* Independent variables in this study were age, sex, 
raca^ father- a education, and non--economic benefits* Hu found that marginal 
rate of return on vocatlonal^technical education in Detroit was 31.8 percent 
and in Philadelphia 8*2 percent. In a similar but separate study Gorazimil 
(1966) found the rate of return in Worcester ^ Itossachusetta , at 17,9 percent 
on Investments in vocational-- technical education. In still another study 
conducted by Kaufman and Lewis (1968) ^ the returns in New York were 4.6 per- 
cent for males and zero for females. 

Schriver (1971, a) in a statewide study of iermessee area vocational^ 
technical school graduates found that vocational education increased labor 
force participation of the graduates. Some of the other findings of this 
survey which collected follow-up data from 1,701 former students selected 
from vocational-technical schools are listed belowi 

1, Students with the lowest educational ability before entering voca- 
tional program received the greatest benefits from vocational train- 
ing* 

2, Vocational trainings however, v/as of aome benefit to every graduate 
regardless of educational attainment , 



3. Total public rate of return on investment In vocational education 
6,3 percenc, whereas return on private investment by students was 
13*6 percent.. 

Somera and others (1971) conducted nationwide study in which cost^ 
benefit comparisons were made of secondary , post^secondary ^ and college 
level vocational education programs. Comparative data were also collected 
from vocational education drop-outs and academic high school graduates. The 
economic pay'-off from junior college vocational programs was found to be the 
highest even after discounting the cost of additional schooling. The study 
recommended Incr^sed emphasis on general education in vocational training at 
all levels* 

Schriver and Bowlby (1971, b) conducted a study to determine relationship 
between student characteristics and the benefits derived from vocational educa^ 
tlon programs. Important findings from this study which surveyed 127 matched 
pairs of vocational and non-vocational graduates from schools in Memphis ^ 
Tenntissee, are, lieted, belowi 

1* There was negative correlation between benefits from vocational 

training and the I» Q. of students. 
2* Health Education program graduates derived the greatest benefit from 
vocational training. 

3, Male graduates derived greater benefits from vocational education 
than female graduates* 

4. Vocation education graduaten derived greater benefita from vocational 
training than non-^vocational graduates if the former (vocational 
graduates) were working on jobs related to their training* 



From a study of technical education graduates, Carroll and Ihner (1966) 
found that post^secondary technical graduates earned only $11 more on their 
initial job after graduation than the high school vocational graduates* How^ 
avers after four years on the job^ the technical education graduates had in^ 
creased their margin to .$107 per month. Also, the work week of technical 
graduates wag 2.7 hours shorter than the high school graduates. Social return 
on technical education programs was estimated at 16,5 percent and private rate 
of return was put at 22 percent* Non-monetary benefits of technical education 
were not considered for this study , 

In order to assess the impact of vocational education on blacks, Teh^wei 
Hu and others (1969) analysed data on white and non=white high school graduates 
from 1959-60 graduatlji^ classes in Detroits Philadelphia, and Baltimora, Some 
of the significant findings from this comprehensive study are the following: 

1. The eniployment rate for whites was significantly higher than non=»whltas* 
2* White graduates earned an average $124 per month more than non-whites 

during the first year of their employments 
3* After six years there was no significant difference in the monthly 
earnings of whites and non-whites, however, non-whites worked 8,44 
percent more hours on thfli jobs to earn the same income as non-whites, 
4. For black males It was better if they graduated from vocational-technical 
education programs rather than from comprehensive high school programs* 
For black females, however, ±c was better for them to graduate from 
comprehensive high schuol programs rathar than vacatlonal educaciun 
programs, 

Summary_ 

On the basis of available evidence, It is clear that vocational education 
is more cost-effective than academic education or comprehensive high school 

ERIC 



education, Howevar, the benefits vary considerably between program service 
areas of vocatioMl edunation* CosC benefit analysis of different occupa- 
tioMl skills is atill inconclusive and does not indicate the comparative 
benefits of different special tias in vocational education- 
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Procedural Studies 

Several states, schools, and agencies have developed follow-up 
guides and manuals. In addition to data collection instruments there are 
guides to data compilation and analysis^ computer programs and software 
packageSj and reporting formats for the convenience of administrators, re-- 
searchers and other concernad personnel* Since it is not possible to list 
all the guides and manuals available In every state^ only a few selected 
ones have been reviewed In this section, Pucel and others (1970) demon-- 
atrated in Minnesota how the response rate to a follow-up questionnaire 
can be increased by offering incentives which vary from a questionnaire 
printed on colored paper to a cup of coffee (instant coffee in a small bag) 
enclosed with the questionnaire. Significant increase in response rate us- 
ing different incentives or combination thereof is claimed by the authors* 
They have some helpful suggestions for increasing response rates to follow- 
up questionairea . 

Another study conducted by Frazler and Harris (1970) in Oklahoma com-- 
pared the cost-ef f ectivenesa of followup conducted by asking teachers pertinent 
questions versus sending mail questionnaires directly to the former students. 
They found that data collected about former students of vocational education 
programs using teachers as a primary source of data compared very well with 
data from mail questionnaire directly from the students. The authors j therefore, 
concluded that since both methods collected data which were biased in certain 
respectSj on cost basis alone, the "teacher follow-up" was a preferrGd method 
of data collection^ 



A study by Gaddia (1970) in Utah outlined the Instrumentation and 
methodology to conduct a flve=year follow-up of vocational students. The 
instrumenta were designed to collect data on cost-benefit analysis and 
evaluative comparison of vocational programs. McCracken (1971) developed 
a set of three guides outlining rationale and data needs of follow-up and 
job placement activities. The guides were targeted at school board members, 
school administrators, and vocational teachers. 

Pucel (1973) developed a rationale and methodology for conducting 
follow-up in Mirmesota. An important feature of this research study is the 
effort to measure job satisfaction and employer satisfaction as a part of 
the follow-up instrumentation. Robertson (1973) developed a descriptive study 
on the utilization of follow-up for local program planning by school adminis- 
trators. Needs for planiiing, goal setting, and evaluation are described In this 
publication. Paul (1975) developed a system of both .hort range and long range 
follow-up instruments and data collection procedures. The system which was 
pilot tested and validated in Kentucky provides a comprehensive data base for 
evaluation and longitudinal comparison of vocational education programs. Similar 
procedural studies have been conducted in California, Washington, Wisconsin, 
Mlnttei.ota, Colorado, Arizona, Oklahoma, New Mexico, South Carolina. Ohio, 
Michigan, Illinois, Pennsylvania and Tennessee. 
Summary 

Procedural studies and guidelines ore necessary prequisites to a standardized 
national followup system for vocational graduates. Before n system i« adopted as 
a national model, however. It will be necessary to define in clear terms a 
national manpower policy outlining specific objectives for vocational education 
and manpower programs. Currently available systems are all geared to local and 
state needs and art. too diverse in scope and approach to generate easily comparable 
data at a national level. 



FUTURE TRENDS 

Budgetary constraints and political realities arc exerting inexorable 
pressure on vQcational education adminiscrators throughout the counury to 
make vocational education more responsive to the needs of the economy. 
Placement of graduates for which they are trained la now required from vo- 
cational educators so that every school is functioning as an employment 
agency. In order to satisfy the demands of accountability, vocational ed- 
ucator must have more and better data, data which are accurate, timely, and 
locally specific. 

Lawrence and Dane (1974) recommend that a nationwide follow-up system 
should be established using any one of the models already developed, tested, 
and validated. Federal govarnment support In terms of data from the Internal 
Revenue Service and Social Security files will be necessary to establish a 
comprehensive data base of the kind recommended by state administrators. Data 
on jobs, initial wages, hours worked on jobs, and job satisfaction should be 
essential elements of this data file. 

Another area where very little work has bean done lies in the field of 
economic analysis. It is heartening i .Bt= increasing interest among economists 
and social scientists in developing and testing new and innovative methods to 
measure cost and benefits of vocational education. Demand for complete account- 
ability of vocational programs, alread gaining momentum, will keep the need for 
cost-benefit type studies at a high c agh le%'el to attract, it is hoped, re- 
searchers to this challenging area of inquiry. 
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Vocational educators seem to hava been preoccupicid with the studentB 
and their needs (including their need for a Job). The employer and his 
needs were considevad secondary anci external to the educational process* 
Development of career education programs, the recessionary economy, and 
depressBd labor market have brought about a marked change in this attitude* 
There seems to be an insatiable demand for locally oriented occupational 
demand data and Information about job contents* Occupational and task 
analysis studies have significantly increased during the past few years* 
Contacts between the vocational educators and employers have also been 
improving steadily. 

In a recently conducted survey (Center for Vocational Educationj 1975) , 
where vocational education administrators 5 teachers ^ and supervisors were 
asked to list and rank-order the criteria which should be used to evaluate 
vocational training programs ^ the responses were very revealing* The top 
five criteria to measure the effectiveness of vocational education out of a 
total of 66 reflected the awareness of employer needs by the vocational 
educators. The table on the following page lists the ten criteria ranked 
highest in this survey. This t and of increased awareness of employer needs 
is also reflected in the number of research studies to measure employer 
satisfaction with the vocational graduates. One of the most important studies 
in this area was conducted by Pucel (1973) who developed a questionnaire to 
collect data and measure employer satisfaction as a part of follow-up surveys. 

Little has been doiije thus far in the area of measuring the match between 
skills learned in vocational programs with the actual occupational practices, 
Braden and others (1970) pioneered an effort to match demand with supply of 
manpower that is subject to vocational training. Further work needs to be done 
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TABLE 

RANKINGS OF THE TOP TEN SELECTED CRITERLA. 





Rank* 


Program content is current with occupacional 
practica 


1 


Employer satisfaction with graduate* s skills 


2 


of oacupation 


3 


program 


4.5 


Basle workj job ethic skills and attitude 
development taught 


4,5 


Attitudes and support of school administrators 
toward vocational education 


6 


Job placemert services available to all program 
traine* ., 


7 


Courses developed with the advice and cooperation 
of representatives of the occupation 


8 


Labor market demand for training provided 


9*5 


Supplies and equipment 


9,5 



*A11 rankings based on number and rank each item received from the total 
smple« 



Source* "Program Evaluation Inventory" The Center for Vocational Education^ 
Ohio State University^ Columbus^ OhiOj 1975. 
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to apply the concept of matching to skills rather than the job titles as was 
dona in the Braden study. Occupational analysis of jobs and behaviorally 
stE;_ad training objectives saem Co be the direction for research studies to 
maasure tha match between training skills and job requirements. 
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CONCLUSIONS 



One of the key elements of regional economic development is the 
availability of hunian resources x^ith the right skills > in right numbers, 
and at the right time* A pool of trained manpower is a prerequisite for 
attracting new investments in industry and business to promote economic 
development. At the same time, new and developing industries create ad-^ 
ditlonai demand for trained manpower and thus encourage new and improved 
training programs » 

In any plans for developing our human resources, vocational education 
programs play a dominant role because they impact a large number of youths 
and adults p In 1974 there were 13*5 millions persons enrolled in public 
school vocational education programs in the United States* In addition 
about two million persons are trained annually by private schools* The 
Impact of these programs on the labor market, however^ is a function of 
both prevailing economic conditions and their own efficiency* The latter 
can be improved by systematic planning and judicious allocation of resources* 
Both of these factors are f acil ' tated greatly by a continuous supply of labor 
market and economic analysis data* 

Economic analysis of vocational education programs involves the cost 
data and the Impact measures on the labor market as wall as on the participants 
of training programs* Followiip data are generally collected to measure the 
economic impact of vocational education on the labor market and the individual 
tralnaas , 

A survey of available literature reveals that follow-up studies continue 
to suffer from some severe problemSi some of which are procedural and others 
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are conceptual. Data collection is priinarily geared to questionnaire 
surveys and interviews^ both suffering from the problem on non-^response 
and inadequate sampling, Non-^coordination between the schools and the 
data collection agencies on the one hand and between schools and the 
vocational aducation graduates on the other adds significantly to the 
problem of potentially biased data due to non^response and sampling 
inadaquacies • 

Conceptual difficulties arise from a lack of adequate measures to 
assess the economic and non— economic benefits of vocational education. 
Another problem relates to separating the impact of non'-school activities 
from educational or vocational activities in order to assess the benefits 
from training. Relationship between vocational education and economic 
cycles has also not been studied adequately. There is an urgent need for 
increaf d research activities in these areas of economic inquiry. 

It Is generally agreed that important decisions related to vocational 
education and affecting billions of dollars and millions of people are 
being made without adequate information about the impact or effectiveness 
of vocational education. A very urgent need exists to encourage and sponsor 
research efforts on a higher scale at the state, regional ^ and national level. 
This will be the first step in developing a system for allocation of resources 
for vocational programs and activities to ^develop right skills needed to 
implement regional economic plans. 
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